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ABSTRACT 

This report presents selected interim results from a 
study designed to assess the quality of higher education through . a 
survey of employer satisfaction with the knowledge, skills, and 
attitudes of the university graduates they employ. A 62-item survey 
questionnaire was developed and sent to employers in the West 
Midlands region of England. The survey found that the main areas of 
satisfaction with graduates were their willingness to learn, their 
co-operation, motivation, commitment, drive and energy, desire to 
achieve, and dependability. Employers were dissatisfied, however, 
with graduates' prior knowledge of the job, relevant work experience, 
knowledge of the organization, commercial awareness, experience of 
the world of work, and financial knowledge. Overall, it would seem 
that line managers and people in commerce and industry who work 
closely with recent graduates are sat.^sfied but not enthusiastic 
about most of the graduates they employ. An appendix contains a 
rank-ordered listing of the satisfaction scores. (MDM) 
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Employer Satisfaction 



THE QHE PROJECT 



The three year QHE project was launched in September 199 1 . It is sponsored by a 
partnership of education, govenunent and business. There arc currently 28 sponsors 
in the United Kingdom including the Department for Education, the funding 
councils, accrediting bodies, major employers, employers' organisations, higher 
education instituti(ms, research and training organisations. It is independent of any 
single organisation or institution but its physical bast is The University of Central 
England in Birmingham. 

Each of the sponsors is represented on the project steering group which meets 
about once every three months. Sponsors are expected to take an active part in 
determining the scope and development of the project. 

Dr Lee Harvey is the Senior Research Fellow and the project manager is Professor 
Diana Green, Pro- Vice Chancellor of The University of Central England, 

If you would like more information about the project please contact Dr Lee Harvey 
at thf; following address: Quality in Higher Education, Baker Building, The Univer- 
sity of Central England in Birmingham, Perry Barr, Binningham, B42 2SU, 
Fax. 021-331 6379 or 021-331 6317. Tel: 021-331 6305 or 021-331 5570. 
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Employer Satisfaction 



Introduction 

In this session I would like to briefly present some interim results of ongoing research 
on employer satisfaction. There will be no attempt to make definitive claims about 
employer views. The aim is to outline some broad indications of employer satisfaction 
and encourage a debate about die implications for higher education. 

The QHE Project has undertaken a wide range of enquiries into perceptions of quality 
in higher education. The project, based at the University of Central England in 
Birmingham, is funded by a consortium of education, government and industry. An 
unaeriying aim of the project is to inform policy. The first stage of the research focused 
on the identi^Tication of the criteria that different stakeholder groups regard as important 
in assessing quality ui higher education. 

As part of that process we have looked in some detail at employer perceptions. During 
1992 we undertook some qualitative and quantitative research to establish tfie criteria by 
which employers think higher education should be assessed.^ Through that research we 
began to get a feel for the kind of graduates employers wanted from higher education. 

To take this further we devised an employer satisfaction survey. That is, we asked 
employers how satisfied they are with the graduates they employ in terms of a range of 
knowledge, skills and attitudes that graduates might be expected to exhibit. 

Most research in this area, including our earlier research, focuses on the opinions of 
graduate recruiters, personnel officers and so on. We attempted, instead, to obtain the 
views of line-managers and people who work closely with graduates within 
organisations. 

Methodology 

It is notoriously difficult to obtain employer views of higher education. We wanted to 
assess employer satisfaction with a range of graduate attributes. We used a five point 
rating scale for each of the 62 attributes, subdivided into 5 groupings: 

knowledge 

• general transferable skills 

• self-skills 

• attitudes 

• prior experience of the work situation. 

To obtain considered ratings for each item, it was necessary to design a self-completion 
questionnaire rather than to employ face-to-face interviewing. Furthermore, time and 
resources precluded large numbers of face-to-facc interviews. 

Previous experience had suggested that obtaining employer views is unlikely to be 
successful unless you identify potential respondents within organisations, when using a 
jnailed questionnaire, there are a number of potential addressees: 

1 the organisation - *to whom it may concern*; 

2 a specified job description - *the worics manager* or *the personnel officer*; 

3 chief executive (for downward transmission); 

4 a particular individual (whose name you have obtained from somewhere); 

5 a particular individual suggested to you by an intermediary to whom you can 
refer in the covering letter, 
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6 a particular individual you know (or with whom you have established contact 
through a prc-contact technique). 

At the pilot stage, we used a mixture of options 3, 4, 5 and 6. We ruled out the first 
two as ineffective on the basis of previous research. However, we increasingly carne to 
the view that the most fruitful approach was to pre-contact an appropriate person within 
an organisation. The contacted individual would either be asked to: 

♦ complete the questionnaire (if appropriate) 

♦ take responsibility to find, and ensure a return from, a suitable respondent 
within the firm 

♦ co-ordinate the distribution and return to a small group of suitable respondents 
if the organisation was sufficiently large or diverse to warrant multiple 
responses. 

Approaches, other than the pre-contacts, were astoundingly unsuccessful* For 
example, at the pilot stage we undertook direct mailing of the questionnaire to chief 
executives of all 162 firms affiliated to the West Midlands CBI making it clear that the 
CBI supported the research and had suggested the contact. However, there was no way 
of knowing, from the information provided, the size the the organisations and whether 
they recruited graduates. 

As a control a further 27 respondents, in the West Midlands, akeady on the QHE 
mailing list were also circulated with the questionnaire. 

The replies were as follows: 

From the CBI mailing to 162 named contacts (mainly chief executives) we received: 
2 replies with completed questionnaire 

2 replies without questionnaire indicating that they did not recruit graduates. 
4 letters returned by the post office marked 'gone away'. 
154 non responses. 

A usable response rate of 1.3% 

From the contiol mailing of 27. West Midlands contacts: 

7 separate replies with completed questionnaire 
1 reply containing 6 completed questionnaires. 

A 30% response rate (excluding the bonus of multiple replies). 

Three things that might have increased response have to be taken into account: 

1. there was no follow-up of non-respondents as this was at the pilot stage 

2. no post-paid reply label was included in the original mailing 

3. tfie pilot questionnaire was somewhat more complex than the final version. 

However, the pilc^t clearly indicated that mailing questionnaires to employers without 
any prior contact is an inappropriate technique as it secures very few responses for the 
time and energy invested. 

For the main research we thus used pre-contacts. Making these kind of contacts, 
however, takes a lot of work and is a very time-consuming and slow process. 

It is also important to bear in mind that the sample, built up in this way, has a number 
of characteristics: 



QHE Employer Satisfaction Interim Report Presented at the SRHE Conference^ Brighton, 14/121993 



• it is not random G^ut a randomly generated sample with a response rate of 5% 
isn't either!); 

• it snowballs within organisations where a co-ordinator is used; 

• it tends to be informed - pre-contacted respondents tend to be knowledgeable 
and interested. 

The point of the research, though, is not to provide generalisable statistical results from 
random samples but to provide initial indicators of employer satisfaction and to suggest 
a suitable methodology for use by instituticMis (or faculties) to systematically assess the 
satisfaction of employers of their graduates* 

In addition to the quantitative research we are also undertaking qualitative research 
through the use of group discussions, in-depth interviews, analysis of responses to 
open questions and comments made through correspondence* This presentation of 
results will, however, concentrate mainly, on the results of the quantitative research. 

Expectations 

The Council for Industry and Higher Education (CIHE) noted, in 1987, that 

employers will increasingly expect higher education to give a grounding in personal skills: 
communication, problem-solving, teamwork, leadership. 

The assumption was that higher education put too much emphasis on subject content 
and did not adequately equip graduates to work in modern organisations. It was 
implicitly accepted that graduates had a sound knowledge base in their subject, and it 
was perhaps the transferable skills that needed addressing directly. Higher education 
institutions tended not to take too seriously the need to directly address the 
communication skills of their graduates, after all, much of higher education was about 
students communicating their work through essays or laboratory reports. 

Satisfaction ratings 

> 

These results are interim results based on the first 76 respondents (up to 30 November 
1993). The results should not be taken out of context .The research is ongoing and a 
full report will be made available early next year. 

To make the data easier to understand, the five point satisfaction scale for each item was 
converted into a scale from 0 to 100, with 0 representing very dissatisfied, 100 very 
satisfied and 50 a neutral midpoint between satisfaction and dissatisfaction. 

Overall, the average score for the vast majority of items was over 50. Only three items 
showed an average that fell into the dissatisfaction area under 50. However, 48 items 
had averages within the range 50 to 70 which does not suggests that employers were 
overwhelmingly satisfied. 

Areas of greatest satisfaction 

The results for the 62 different items are shown in the Appendix. The main areas of 
satisfaction ;vith graduates were their willingness to learn, their co-operation, 
motivation, commitment, drive and energy, desire to achieve and dependability. It may 
come as a surprise to some teachers that they arc producing such highly motivated and 
committed graduates. 

Employers show a high degree of satisfaction with graduates* information technology 
skills (which is probably not a surprise) and with the teamworking ability of recent 
graduates (which possibly is surprising). 
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Employers arc also satisfied with the flexibility and adaptability of graduates. 
Areas of least satisfaction 

At the other end, employers were dissatisfied with graduates* prior knowledge of the 
job, and relevant work experience, knowledge of the organisation, commercial 
awareness, experience of the wwld of woric and financial knowledge. 

Graduates do not appear to have particularly good negotiating skills and employers are 
relatively dissatisfied with their leadership and problem-setting ability, decision-making 
and infiuencing skills. 

Knowledge and understanding 

Perhaps rather mere surprising is the relative dissatisfaction with the specialist factual 
knowledge, deep understanding and ability to summarise key issues. Understanding of 
core principles fared better witii a score of 67 (ranked in 21st place). 

To assess whether satisfaction with specialist knowledge and understanding differed 
depending on the nature of the post, respondents were asked to indicate if the post filled 
by the gr^uate required specialist factual knowledge. 

Those who indicated that specialist knowledge was needed gave a higher, but not 
statistically different, satisfaction rating (ranked 46th) to graduates' specialist 
knowledge than the group for whom specialist knowledge was not needed (ranked 
57tfi). Even so, for tiie group where specialist knowledge is needed, a satisfaction 
score of 59 is not encouraging (see Appendix). 

Rather more encouraging was the higher satisfaction rating given to ^understanding 
core principles' by the group for whom specialist knowledge was a necessity (mean = 
69, rank 12th). 

Conversely, the group for whom specialist knowledge was not needed were more 
satisfied witii graduates' deep understanding, general knowledge and knowledge of 
social and political issues. 

Communication skills 

The interim results of the QHE research on employ**^ satisfaction indicate considerable 
dissatisfaction with the communication skills of graduates. Written and oral 
communication skills, with a satisfaction ranking of 46th and 32nd respectively are 
rather worrying. 

The qualitative research suggests that graduates are not good at communicating with a 
variety of audiences. They can write essays and laboratory reports but rarely seem able 
to present complex ideas in jargon-free language. 

Employers say that poor communications skills are evident at all stages of the 
recruitment process and beyond. Graduates often do not express themselves well on 
application forms. They are often incapable of writing concisely and identifying tiieir 
strengtiis vis d vis the post. There are classic examples, such as die science graduate 
who waffled on for pages and waxed lyrical about interests in all matters literary in his 
application for a job as a journalist 

Occasionally employers do come across applications from graduates that contain a large 
number of spelling, grammatical and typing errors and are pooriy laid-out, and tiiis is 
rather worrying. ^ 

Oral presentations in assessment centres are frequently dismal. Employers have noted 
that graduates are often more comfortable commuuicating with computers than with 




QHE Employer Satisfaction Interim Report Rresented at the SRHE Conference, Brighton, 14/121993 



people and this is reflected in the relatively high satisfaction rating given to graduates 
ability to use information technology (8th). 

Graduates, once in the job often show a startling inability to write reports, minutes of 
meetings, or even business letters* Yet, good communication skills are very important 
and possessing good communication skills is often seen by employers as an indicator 
of potential success* 

Employers have suggested that, amongst other things, higher education study 
prograinmes might incorporate the following to improve communication sldlls: 

give students experience of writing for different kinds of audiences (other 
than the lecturers who teach cm programmes of study); 

• give student the opportunity to write different kinds of document (other than 
standard essays and laboratory repwts); 

• provide more opportunities for students to undertake oral presentations 
(preferably to mixed audiences); 

• provide communication skills training for students as an integral part of 
course units; 

• provide staff development for teachers that enables them to coach students in a 
variety of communication skills* 

However, employers are not blaming higher education entirely for the relatively poor 
communication skills of graduates, schoo? and further education must also share the 
responsibility, as must die government for reducing, far too drastically, the unit of 
resource in higher education. 

Conclusion 

Overall, it would seem that line-managers and people in commerce and industry who 
work closely with recent graduates are satisfied with graduate abilities without being 
enthusiastic* 

Reasonable expectations of high levels of satisfaction in such areas as specialist subject 
knowledge and communication skills are not fulfilled. On the contrary, they score 
rather disappointingly on the satisfaction scale* 

On the other hand, the teamworking, willingness to learn, flexibility, adaptability and 
personal attributes such as enthusiasm and determination are quite satisfactory. So too 
are graduates information technology skills. 

By no means all of the qualities, identified by CIHE six years ago, are being developed 
by higher education to the satisfaction of employers. It seems that institutions are doing 
relatively well in developing teamworking and personal skills but rather poorly in 
relation to communication, problem-solving and leadership* 

However, one nagging doubt about all this remains* Is the satisfaction that employers 
express with teamworking, flexibility, willingness to leam, and so on, a satisfaction 
with the output of higher education or a satisfaction with their own recruitment 
processes? 



ENDNOTES 

^ See Harvey, L.. cd.. 1993. Quality Assessment in Higher Education: Collected Papers of the QHE 

Project. Birmingham, QHE. 
2 The job-sceking skills training on The Living Soap, provided a graphic illustration. The trainer 

told the best intcrvicwccc that he would not have been interviewed in real life because his 

curriculum vitae and application form were the worst he had ever seen. 



APPENDIX: SATISFACTION SCORES AND RANKS inc SFK SUBGROUPS 



Attribute 



Vir ingness to learn 
Co-operation 

Desire to achieve/motivation 

Commitment 

Self-motivation 

Drivc/snergy 

Dependability^Iiability 

Ability to use information technology 

Teamwork 

Flexibility 

Equipped for continuous education 

Self-confidence 

Adaptability (intellectual) 

Adaptability (organisational) 

Enquiry and research skills 

Numeracy 

PersistenceAenacity 

Self-management 

Analytic ^ility 

Rapid conceptualisation of issues 
Understanding of core principles 
Interest in life-long learning 
Consideration for others 
Logical argument 
Loyalty 
Initiative 
Technical ability 

Can deal with large amounts of info. 
Problem solving ability 
Maturity 

Can cope with pressure/stress 

Communication skills (oral) 

Curiosity 

General knowledge 

Tolerance 

Pkuining ability 

Critical ability 

Independent judgement 

Leadership potential 

Imagination 

Time management 

Tact 

Organisational skills 
Creativity 

Knowledge of social/political is:ues 
Communication skills (written) 
Ability to relate to wider context 
Can summarise key issues 
Innovation 
Influencing skills 
Specialist factual knowledge 
Leadership ability 
Problem setting ability 
Experience of the world of woric 
Decision making skills 
Deep understanding 
Relevant wojk experience 
Commercial awareness 
Financial knowledge or understanding 
Negotiation skills 
Knowledge of the organisation 
Prior knowledge of the job 
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